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PREFACE 


The Agriculture and Resources Inventory Surveys Through Aerospace Remote 
Sensing Is a 6>year program of research, development, evaluation, and app11> 
cation of aerospace remote sensing for agricultural resources wtilch began In 
fiscal year 1980« This program Is a cooperative effort of the National Aero- 
nautics and Space Administration, the U.S. Agency for International Develop- 
ment, and the U.S. Departments of Agriculture, Commerce, and the Interior. 

The research which Is the subject of this document was performed within the 
Earth Resources Applications, Space and Life Sciences Directorate, at the 
Lyndon B. Johnson Space Center, National Aeronautics and Space Adminis- 
tration. Under Contract NAS 9-15800, personnel of Lockheed Engineering and 
Management Services Company, Inc., performed the tasks which contributed to the 
completion of this research. 

The following Individuals contributed to this effort: Dr. A. G. Houston, NASA, 

helped with his Interest and suggestions. M. L. Sestak, Lockheed, put together 
the original data set, and Dr. P. Doralswaiqy, Lockheed, was responsible for the 
model Improvements and much of the Information on the Inner workings of the 
models. 
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1. BACKGROUND AND OBJECTIVES 


This report describes the results of the evaluation of the performances of can- 
didate agrometeorological crop calendar models* These models have been pro- 
posed by the Supporting Research Crop Calendar Project element for possible 
application to labeling procedures of the Agriculture and Resources Inventory 
through Aerospace Remote Sensing (AgRISTARS) program. This study Is an 
addition to the 1980 U.S. and Canada Spring Wheat and Barley Exploratory 
Experiment. 

During the Large Area Crop Inventory Experiment (LACIE). spring Mheat planting 
date and crop development stage estimates based on historical normals were 
Improved by the use of the Feyerherm planting date and Robertson Spring Wheat 
Crop Calendar Models. Modifications were subsequently made to the Robertson 
model to improve deficiencies Identified in LACIE evaluations. These 
modifications were tested along with a state-of-the-art barley model (Williams, 
ref. 1) which became available for testing for the first time. 

This study Investigated two crop planting date (or starter) models, namely the 
Feyerherm (ref. 2) and the Normal models (ref. 3), and four crop growth stage 
models. These crop development stage models are designated the Original 
Robertson Model (RO), the Improved Robertson Version 1 Model (Rl), the Improved 
Robertson Version 2 Model (R2), and the Williams Barley Model. The evaluation 
was based cn 1979 ground- truth data consisting of 49 spring small grains blind- 
site segments In the U.S. Great Plains region and contains three crop 
categories of Interest, spring wheat, durum wheat, and barley. For the 
purposes of this study, durum wheat Is In the same category as spring wheat* 

The primary objective of this study was to determine the combination of the 
crop planting date model and the crop development stage model which would most 
accurately predict the crop development stage as a function of time for spring 
wheat and barley. Other objectives were to determine If the Williams model 
predicts more accui'ately the barley development stages than do the Robertson 
models and to determine whether the models selected would produce results which 
are sufficiently accurate to br used In labeling and classification procedures. 


1-1 



2. APPROACH 


The Feyerherm and the Normal planting date models were evaluated on their 
ability to accurately predict the median planting dates for the segments. The 
basis for comparison was the ground-truth median planting dates which yielded 
errors measured In units of days associated with the models. The ground- truth 
median planting dates for the spring wheat crop and for the barley crop were 
obtained by calculating the date at which 50 percent of the spring wheat or the 
barley fields In each of the segments were observed to be planted. 

The performances of the three Robertson development stage models were evaluated 
using the ground- truth median development stages as the basis for comparison by 
use of the observed median planting dates to Initiate the models. The ground- 
truth median development stages for the spring wheat crop and for the barley 
crop were obtained by calculating the observed median stage for the spring 
wheat or the barley fields within each of the segments for each of the dates on 
which the stages were observed. The comoarlson of the models' predictions 
versus the observed crop stage yielded errors In terms of crop stages 
associated with each of the models. 

The barley development stage model was evaluated using the observed median 
planting dates for barley to Initiate the models and subsequently to compare 
the model prediction of stage with the ground- truth median development stages 
for barley. 

The planting date models and the development stage models were evaluated 
Independently so as to minimize any adverse consequences to the performances of 
the crop development stage models as a result of Inaccurate planting date Input 
to the models. 

Certain assumptions had to be made regarding the ground- truth data used for 
evaluation. The 49 segments contained from 15 to 30 special fields that were 
distributed through the segment and observed periodically. The locations and 
selections of these special fields were assumed to be random, and the 
periodically observed stages were assumed to be truly representative of crop 
development at those times. 
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3. DATA SET 


The data set used In this stu(|y comprised 49 blind-site segments In the spring 
wheat areas of the U.S. Great Plains and 1979 periodic observations collected 
by enumerators at 9- to 18-ddy Intervals corresponding to Landsat overpass 
dates (ref. 4). These periodic observations contained planting dates and crop 
development stages for each field In the segment. The number of fields within 
a segment varied from 15 to 30 spring wheat or barley fields. The planting 
date model contained the observed planting dates and predicted planting dates 
for spring wheat and barley. The crop stage model data contained observed crop 
stages and predicted crop stages for each of the models. The crop stages were 
given In terms of the Robertson Phonological Crop Scale. 

Figure 1 Is an Illustration of the Robertson Phonological Crop Scale that was 
used In this study* superimposed on the Feekes Scale description of Identifi- 
able crop stages (refs. 5 and 6). Figure 2 shows the geographic location of 
the segments that contain the data set used In this study* 
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Figure 1.- Illustration 



Figure 2.- Geographic locations of the segments 




4. DESCRIPTION OF THE MODELS 


Robertson’s concept (ref. 5) Is based on certain physiological processes that 
are central to the developnent of spring Mheat. Since temperature and photo* 
period are two primary envlronmeital factors that Influence the phonological 
development, a photothermal concept was used to compute the development of a 
crop over five fairly short and uniform physiological periods. The trlquadra- 
tlc responses of temperature and photo-period were estimated for each of the 
phenol ogical stages by an Interative regression technique. 

The Improved Robertson Version 1 and the Improved Robertson Version 2 Models 
are Improvements over the Original Robertson Model with respect to the 
photo-period and temperature responses. The photo-period response Is limited 
to stages between emergence and flowering. The thermal responses for sub- 
sequent stages are adjusted to represent realistic physiological responses* 

The development rates of spring wheat Immediately before and after flowering 
are responsive primarily to the dally maximum temperature. 

The Williams Barley Model Is based on approximately the same concept as the 
Robertson model, the difference being that the coefficients were developed 
specifically for barley. 

Figure 3 Is a schematic of the models' Input requirements and resulting output 
data. The Normal model, although not an agrometeorological model. Is Included 
In figure 3 for the sake of completeness. It Is based on historical data 
averaged for the crop reporting district. The dally minimum and maximum 
temperatures are obtained from reports of weather stations nearest the segments. 
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Figure 3,- Schematic of the evaluation process 



5. RESULTS FOR PLANTING DATE MODELS 


Both the Feyerherm and the Normal models produce median planting date estimates 
at the segment level. The performances of the models for the spring wheat 
fields and the barley fields were evaluated separately. 

Figure 4 Is a histogram showing the distribution of errors measured In days for 
the Feyerherm versus the Normal planting date models applied to spring wheat 
fields. The error Is the difference between the median ground- truth planting 
dates and the model -predicted planting dates, and the distribution of these 
errors should give an Indication of the bias associated with the models. As 
can be seen from figure 4, both distributions appear normal, the differences 
being the locations of the midpoints of these distributions. The Feyerherm 
model has a positive displacement, whereas the Normal model has a negative dis- 
placement. This Indicates that the Normal model Is very early compared to the 
ground-truth median planting dates, while the Feyerherm model 1$ slightly 
late. Based on reports jointly published by the U.S. Department of Agriculture 
and the National Oceanic and Atmospheric Administration In the Weekly Weather 
and Crop Bulletin, the 50 percent planting date of spring wheat In North Dakota 
for 1979 was 13 days late. Thus, the Normal model performed as expected. 

Table 1 summarizes the statistics on the errors measured In days for the 
Feyerherm versus the Normal model applied to spring wheat. The sign test shown 
In table 1 Is based on the absolute magnitude of the error and gives the 
percent of times one model Is closer to the ground- truth than the other model. 

TABLE 1.- COMPARISON OF ERRORS IN PLANTING DATE MODELS 
APPLIED TO SPRING WHEAT FIELDS 



Feyerherm model 

Normal model 

Number of segments (n) 

49 

49 

Mean error (In days) 

+3.9 

-10.4 

Standard deviation (In days) 

7.0 

7.50 

Median error (In days) 

+4.0 

-11.0 

Sign test (1) 

75.5 

22.4 

(2% tied) 
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NUMBER OF SEGMENTS 



Figure 4.- Distribution of errors (in days) for the Feyerherm 
versus the Normal planting date models applied to barley. 
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From table 1 It can be seen that, on the average, the Feyerherm model Is 
3.9 days late compared to the observed planting date, whereas the Normal Is on 
the average 10.4 days early compared to the observed planting date. Statistic- 
ally, the sign test Indicates that the Feyerherm model Is significantly better 
than the Normal model at the 6-percent level of significance. The overall 
statistics Indicate that the Feyerherm model Is closer to the ground- truth than 
the Normal model In predicting spring wheat planting dates for this year. 

Figure 5 Is a histogram showing the distribution of error measured In days for 
the Feyerherm versus the Normal planting date models applied to barley fields. 
As can be seen from figure 5, both distributions appear normal. However, the 
Feyerherm model midpoint has a positive displacement, whereas the Normal model 
has a negative displacement. This Indicates that the two models are, on the 
average, late and early compared to the ground- truth median planting dates as 
seen for barley fields. 

Table 2 summarizes the statistics on the error measured In days frxsm the 
Feyerherm versus the Normal model applied to barley fields. From table 2, It 
can be seen that, on the average, the Feyerherm model Is 2.9 days later than 
the observed planting date, whereas the Normal Is, on the average, 10.9 days 
earlier than the observed planting date. The sign test Indicates that the 
Feyerherm model Is better than the Normal model, though not statistically sig- 
nificant at the 5-percent level of significance. The overall statistics 
Indicate that the Feyerherm model Is better for this year than the Normal model 
Is for predicting barley planting dates. 

TABLE 2.- COMPARISON OF ERRORS IN PLANTING DATE MODELS 
APPLIED TO BARLEY FIELDS 



Feyerherm model 

Normal model 

Number of segments (n) 

44.0 

44.0 

Mean error (In days) 

+2.9 

-10.9 

Standard Deviation (In days) 

11.48 

9.55 

Median error (In deys) 

+4.5 

-11.5 

Sign test 

63.6 

36.4 
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Figure 5.- Distribution of errors (in days) for the Feyerherm 
versus the Normal planting date models applied to barley. 
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6. APPROACH: CROP DEVELOPMENT STAGE MODELS 


The three Robertson models and the Williams Barley Model were started using the 
ground-truth median planting dates for spring wheat and barley fields as Input 
to the models. They were evaluated on their ability to accurately predict 
median crop development stages for spring wheat and barley between stages 2.0 
and 6.0, which are the emergence through ripe stages. 


In an attempt to determine If the models performed differently during different 
parts of the growing season, the models were evaluated at five ranges of stages 
as shown below. 


1. Stage 2.0 to 2.9 

2. Stage 3.0 to 3.9 

3. Stage 4.0 to 4.9 

4. Stage 5.0 to 5.9 

5. Stage 6.0: 


emergence to prejointing 
jointing to preheading 
heading to presoft dough 
soft-dough to preripening 
ripe 


In addition, the overall performance was tested for the entire growing season 
from stage 2.0 to stage 6.0. 
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7. CROP DEVELOPMENT STAGE MODEL RESULTS APPLIED TO SPRING WHEAT FIELDS 


Figure 6 contains scatter plots of the median predicted development stages 
versus the observed median development stages for models RO, Rl, and R2. The 
letters represent the number of data points falling on the character 
(A » 1, B > 2, etc.). The common trend on all three plots Is for the predicted 
growth stage to converge on the 1-1 line. Indicating that the performance of 
all three models Is Improving with time through the growing season. It can 
also be seen from figure 6 that model RO Is progressing faster than models R1 
and R2 by noting that 13 ground truth observations are off scale and greater 
than stage 6.0 (I.e., swathed and harvested). 

Table 3 summarizes the statistics on the errors between the observed stages and 
the predicted stages that were applied to spring wheat at various Intervals 
throughout the growing season. The errors are the differences between the 
predicted stages and the observed stages and should give an Indication of the 
amount of bias associated with each of the models, '^n average positive error 
would Indicate that the model Is ahead of the ground- truth, while an average 
negative error would Indicate that the model was behind the ground- truth. In 
addition, the absolute value of the error was ranked on a scale of 1 to k, 
where k Is the number of models being compared with each other (In table 3, 
k - 3). The sum of the various ranks associated with each model was then uti- 
lized In a Friedman nonparametric test of ranks (ref. 7) to determine If any 
one model produced better results consistently. 

Table 3 shows that there were no significant differences between any of the 
three models when evaluating the overall performance from ground- truth stages 
2.0 to 6.0. The range of the mean error for the three models was two-tenths of 
a stage, and the Friedman T-statlstIc also Indicates that there Is no 
significant difference between the models at the 95-percent confidence level. 

For stages 2.0 to 2.9, there was a . arginal difference between the three 
models. It Is apparent that R1 Is the worst performer of the three models at 
this stage Interval, as Indicated by the statistics on the errors and the 
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TABLE 3.- COMPARISON OF ROBERTSON MODELS APPLIED TO SPRING WHEAT 


Ground-truth 

range 

Statistic 

Robertson 0 

Robertson 1 

Robertson 2 

2.0 - 6.0 

Mean error 


0.2 

0.2 

Entire 

STD 


0.48 

0.46 

growing 

Median error 


0.1 

0.2 

season 

£Rank observed 

■MS 

97.08 

96.71 


Friedman's T-statlstIc: 0.15 (not significant) 

2.0 - 2.9 

Mean error 

0.9 




STD 

0.25 




Median error 

0.9 




ERank observed 

25.00 

37.75 

IliEdli 


Friedman's T-statlstIc; 6.17 (significant) 

BffKSHI 

Mean error 

0.3 

0.7 

0.4 


STD 

0.26 

0.32 

0.26 


Median error 

0.3 

0.7 

0.4 


£Rank observed 

42.42 

95.25 

66.33 


Friedman's T-statlstIc: 41.17 (significant) 

4.0 - 4.9 

Mean error 

-0.2 




STD 

0.26 




Median error 

-0.2 

0.1 



£Rank observed 

89.67 

70.75 



Friedman's T-statlstIc: 4.48 (not significant) 

5.0 - 5.9 

Mean error 

-9.2 

0.0 



STD 

0.42 

0.27 



Median error 

-0.2 

0.0 



iRank observed 

109.45 

66.60 



Friedman's T-statlstIc: 20.92 (significant) 

6.0 

Mean error 


•- 

• - 


STD 

-- 

-- 

— 


Median error 

-0.5 


-0.3 


ERank observed 


1 48.4 

33.5 


Friedman's T*statistic: 24.07 (significant) 1 


At 95-percent confidence level, Friedman's T-statlstIc critical value » 5.99. 
At 99-percent confidence level, Friedman's T-statlstIc critical value » 9.21. 
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Figure 6.- Scatter plots of predicted versus ground-observed spring wheat 
crop stages for the three spring wheat crop stace models. 


observed sum of the ranks. From stages 3.0 to 3.9, there was a significant 
difference between the models. RO appeared to be the best at this stage 
Interval. From stages 4.0 to 4.9, there was no significant difference between 
the models. 

For stages 5.0 to 5.9, there was a significant difference between the models, 
and R1 appeared to perform the best within this stage Interval. Finally, at 
stage 6.0, there was a significant difference between the three models, and R2 
appeared to perform the best of the three models. At ground- truth stage 6.0, 
the mean and standard deviation have not been displayed, as they are not valid. 
The observations obtained beyond stage 6.0 were beyond the range of the model's 
abilities of prediction and, therefore, were not valid. 
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8. CROP DEVELOPMENT STAGE MODEL RESULTS APPLIED TO BARLEY FIELDS 


Figure 7 contains scatter plots of the median predicted development stage for 
model P2 and the Williams Barley Model versus the observed median development 
stage. The letters represent the number of data points falling on that 
character. At first glance, there Is no apparent difference betueen the two 
models, although the barley model appears to be more dispersed about the 1-1 
line than R2 (figure 10). More significant Is the fact that 33 observations 
are beyond 6.0. Indicating that the barley model Is progressing faster than the 
spring wheat mocal. 

Table 4 gives the statistics on the errors between the median ground- truth 
stage and the model predicted median stage applied to barley at various stage 
Intervals through the growing season. It can be seen from table 4 that there 
was a significant difference between the models for the overall performances 
from stages 2.0 to 6.0. The barley model Is significantly worse than at least 
one of the spring wheat models. 

From stage 2.0 to 2.9. there were marginal differences between the models. RO 
appeared to perform the best of the four models as Indicated by the error sta- 
tistics and the observed sum of the ranks. For stages 3.0 to 3.9. there was a 
significant difference between the models. RO appeared to be the best of the 
four models. From stages 4.0 to 4.9. there were no significant differences 
between the models. They appeared to be nearly Identical at this stage Inter- 
val. For stages 5.0 to 5.9. there was a significant difference between the 
models. Model R1 appeared to perform the best. At stage 6.0, there were no 
significant differences between the models, and R2 appeared to perform the best. 
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TABLE 4.- COMPARISON OF ROBERTSON AND WILLIAMS MODELS APPLIED TO BARLEY 


Ground-truth 

range 

Statistic 

Robertson 0 

Robvrtson 1 

Robertson 2 

Williams 

barley 


Mean error 

-0.2 

0.0 

0.0 

0.4 


STD 

0.67 

0.60 


0.60 


Median error 


0.0 


0.0 


ERank observed 

BuE^H 

96.96 

98.58 

126.79 


Friedman's T-statlstIc: 8.74 (significant) 

2.0 - 2.9 

Mean error 

1.0 

1.1 

BB89H 

1.2 


STD 

0.32 

0.37 


0.35 


Median error 

1.1 

1.2 


1.2 


ERank observed 

22.33 

33.50 

24.67 

39.50 


Friedman's T-si 

tatlsti :: 9.4 

>9 (significant) 

3.0 - 3.9 

Mean error 

■liiB 

0.4 

0.4 

0«6 


STD 


0.38 

0.36 

0.42 


Median error 


0.4 

0.3 

0.5 


ERank observed 

50.58 

90.67 

65.08 

113.67 


Friedman's T-statlstIc; 43.79 (significant) 

4.0 - 4.9 

Mean error 

-0.3 

-0.1 

-0.2 

0.1 


STD 

0.32 

0.34 

0.38 

0.52 


Median error 

-0.3 

0.0 

-0.1 

0.2 


ERank observed 

89.42 

62.67 

74.92 

79.0 


Friedman's T-statlstIc: 7.18 (not significant) 

5.0 - 5.9 

Mean error 

-0.5 

-0.3 

-0.2 



STD 

0.57 

0.45 

0.54 



Median error 

-0.6 

-0.2 

-0.2 

HO|| 


ERank observed 

129.93 

70.67 

95.10 



Friedman's T-statlstIc: 28.68 (significant) 

6.0 

Mean error 

Mm 

d» 4m 

«. <• 

mm 


STD 

•• 

m 4m 

A m 



Median error 

-0.9 

-0.7 

-0.6 



ERank observed 

48.0 

35.0 

26.5 

■Q39I 


Friedmn's T-statlstIc: 14.31 (significant) 


At 95-percent confidence level, Friedman's T-statlstIc critical value » 7.82. 
At 99-percent confidence level, Friedman's T-statlstIc critical value > 11.34. 
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Figure 7.- Scatter plots of predicted versus ground-observed barley crop stages for the 
Williams Barley Model and the Improved Robertson Version 2 Spring Wheat Model. 


9. APPLICATION TO LABELING PROCEDURES 


The results shown In the preceding discussion Indicate that the Feyerherm 
planting date model Is more accurate than the Normal model. However* with 
respect to the growth-stage models* It Is not readily apparent that apy one 
model produces consistently better results through the growing season* The 
Improved Robertson Version 2 Model was selected on the basis of Its be1n<; the 
most physiologically realistic model for application to the labeling procedures 
In AgRISTARS (ref. 6). In order that the models be useful for the spring small 
grains labeling procedure* It Is necessary that they be able to predict crop 
growth stages at particular points of time with reasonable accuracy. The 
Reformatted procedure (ref. 9) prescribes and Identifies four Landsat acquisi- 
tion biowindows that are necessary for accurate labeling as shown In table 5. 

TABLE 5.- BIOWINOOWS FOR REFORMATTED PROCEDURE 


Window 

Open 

Close 

1 

Spring wheat 50% 
Planted minus S days 

Spring wheat 50% 
Planted plus 18 days 

2 

Spring wheat 50% 
Headed minus 10 days 

Spring wheat 50% 
Headed plus 10 days 

3 

Spring barley 50% 

Turning to ripe minus 5 days 

Spring barley 50% 

Turning to ripe plus 6 days 

4 

Spring wheat 50% 
Harvested plus 15 days 

Spring wheat 50% 
Harvested plus 30 days 


Using the criteria described In table 5* the predicted growth stages for the 
Improved Robertson Version 2 Model wore converted to days of development to 
reach each of three crop stages described In the Reformatted procedure. 
Biowindow 4 was not calculated because It was out of the ranges of stages In 
which the models are effective. 


Table 6 lists the median ground-truth dates and the median predicted dates for 
three biowindows. Biowindow 1 used the Feyerherm planting date model and bio- 
windows 2 and 3 used thr Improved Robertson Version 7 model for spring wheat 
and barley with the Feyerherm planting date model as the starter model. 
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TABLE 6.- OBSERVED VERSUS PREDICTED BIOUINDOUS 
ACCORDING TO THE REFORMATTED PROCEDURE 


oes 

STATE 

4PU 

CftO 

County 

Seg. no* 

BlMlndow 1 (SU) 
OBSPtT FPIT 

eiowIndOM 2 (SM) 
OBSMCAO ft2HCA0 

BlowIndOM 3 (Barley) 
OBSAIK R2RIPC 

1 

27 

15 

19 

Redwood 

1380 

126 

136 

183 

190 



2 

27 

19 

40 

Grtnl 

1566 

138 

140 

188 

191 

232 

236 

3 

27 

19 

40 

Otter Tall 

1835 

139 

145 

194 

196 

221 

240 

4 

27 

19 

40 

Yellow Nedlcine 

1842 

123 

134 

191 

184 

• 

• 

S 

27 

20 

10 

Marshall 

1514 

158 

148 

211 

198 

236 

239 

6 

27 

20 

10 

Roseau 

1518 

148 

148 

201 

197 

246 

246 

7 

27 

20 

10 

Norman 

1825 

142 

144 

196 

197 

219 

246 

8 

27 

20 

10 

PoU 

1987 

133 

145 

191 

196 

214 

238 

9 

30 

23 

SO 

Fergus 

1948 

136 

123 

188 

188 

219 

220 

10 

30 

104 

10 

Flathead 

1725 

120 

115 

192 

175 

223 

223 

11 

38 

19 


Benson 

1392 

153 

148 

198 

197 

226 

239 

12 

38 

19 

20 

Pierce 

1461 

147 

155 

204 

202 

226 

249 

13 

38 

19 

20 

Bottineau 

1611 

155 

155 

204 

202 

223 

241 

14 

38 

19 

20 

He Henry 

1612 

146 

150 

195 

196 

. 

• 

15 

38 

19 

30 

Ramsey 

1387 

152 

153 

202 

202 

220 

242 

16 

38 

19 

30 

Towner 

1467 

155 

159 

197 

209 

223 

257 

17 

38 

19 

30 

Cavalier 

1617 

155 

154 

214 

202 

247 

242 

18 

38 

19 

SO 

Stutsinan 

1636 

143 

144 

202 

193 

229 

237 

19 

38 

19 

60 

Barnes 

1472 

145 

148 

196 

200 

212 

241 

20 

38 

19 

90 

Dickey 

1658 

133 

142 

193 

195 

217 

233 

21 

38 

19 

90 

Sarqent 

1664 

141 

145 

191 

194 

207 

236 

22 

38 

19 

90 

ta Moure 

1924 

143 

144 

196 

194 

226 

238 

23 

38 

20 

?0 

Pembina 

1584 

159 

147 

213 

197 

226 

240 

24 

38 

20 

3:1 

Grand Fork 

1619 

135 

146 

201 

196 

219 

238 

25 

38 

20 

60 

Cass 

1473 

141 

142 

200 

192 

223 

237 

26 

38 

20 

60 

Train 

1645 

143 

142 

196 

192 

228 

237 

27 

38 

20 

90 

Richland 

1399 

136 

144 

183 

196 

205 

. 

28 

38 

20 

90 

Ransom 

1974 

140 

145 

198 

197 

220 

. 

29 

38 

21 

10 

Burke 

1394 

154 

156 

201 

199 

225 

241 

30 

38 

21 

10 

Hard 

1457 

156 

159 

202 

209 

232 

246 

31 

36 

21 

10 

Hountrall 

1602 

152 

158 

204 

207 

247 

246 

32 

38 

21 

40 

Dunn 

1571 

136 

145 

187 

193 

232 

241 

33 

38 

21 

40 

McKenzie 

1627 

141 

138 

187 

185 

• 

. 

34 

38 

21 

40 

Mercer 

1630 

149 

145 

198 

188 

240 

226 

35 

38 

21 

SO 

Kidder 

1909 

140 

148 

198 

198 

214 

240 

36 

38 

21 

70 

Hettinger 

1650 

136 

141 

186 

190 

. 

. 

37 

38 

21 

80 

Burleigh 

1653 

142 

152 

197 

201 

. 

. 

38 

38 

21 

80 

Morton 

1656 

143 

149 

195 

199 

204 

242 

39 

38 

21 

80 

Cmnons 

1917 

138 

136 

186 

188 

222 

226 

40 

38 

21 

80 

Grant 

1918 

131 

149 

191 

199 

217 

. 

41 

38 

21 

80 

Sioux 

1920 

134 

136 

196 

188 

• 

. 

42 

38 

21 

90 

McIntosh 

1661 

137 

147 

193 

199 

220 

238 

43 

46 

15 

60 

Ml nnehaha 

1784 

123 

134 

173 

189 

210 

229 

44 

46 

16 

50 

Brule 

1676 

118 

121 

183 

• 

201 

219 

45 

46 

16 

, 50 

Sully 

1689 

110 

127 

180 

184 

220 

222 

46 

46 

16 

50 

Jerauld 

1755 

109 

128 

175 

183 

198 

223 

47 

46 

17 

10 

Oewey 

1485 

123 

134 

185 

187 

212 

230 

48 

46 

19 

20 

Edmunds 

1599 

140 

136 

184 

189 

214 

226 

49 

46 

19 

30 

Roberts 

1960 

132 

140 

188 

189 

209 

236 


08SPLT 

* Observed planting date 

OBSRIPE » Observed ripening date 


(ground- truth). 

(ground-truth). 

PPLT 

« Feyerhem planting date 

R2R1PE * Improved Robertson 


(predicted). 

Version 2 Mode) 
ripening date (predicted) 

0BSHE40 

* Observed heading date 
(predicted). 


R2HEA0 

B Improved Robertson Version 
2 Model heading date 
(predicted). 
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Figure 8 shows how the Models would perform in biowindow 1 (planting stage), 

2 (heading stage), and 3 (ripening stage for barley) If the criteria described 
In table 5 for the reformatted procedure were applied to the Feyerherm and 
Improved Robertson Version 2 Models. For example. In figure 8 the vertical 
lines are the limits of the biowindow prescribed In the procedure. The verti- 
cal distance between these two lines Is the width of the window In deys for the 
biowindow (in this case, the window Is 23 deys). Each horizontal bar repre- 
sents the location of the biowindow predicted by the model for each of the 
49 segments. 

In figure 8 for biowindow 1, It can be seen that there Is a fair amount of 
overlap with the prescribed biowindow with a bias towards the positive side 
(I.e., the model Is progressing faster than the observed stage). For 
biowindow 2, there Is a fair amount of overlap with little apparent bias. For 
biowindow 3, there Is poor overlap with a bias on the positive side. Table 7 
gives the probability that the model prediction will be within the prescribed 
biowindow. This was achieved by dividing the total number of days predicted 
Inside the ground- truth window by the total number of days within the window 
for all the segments. It can be seen from table 7 that the Feyerherm model Is 
accurate In predicting the planting data for biowindow 1 (spring wheat plant- 
ing) 73 percent of the time, the Improved Robertson Version 2 Model selects 
days In biowindow 2 (spring wheat heading) 73 percent of the time and In bio- 
window 3 (barley ripening) only 21 percent of the time. 

TABLE 7.- REFORMATTED PROCEDURE BIOWINDOW SELECTION RESULTS 



Biowindow 1 
(spring wheat, 
plant) 

Biowindow 2 
(spring wheat, 
head) 

Blowlndow 3 
(barley, ripe) 

Total percent outside window 

27.0 

27.0 

79.0 

Percent days past the window 
(model late) 

22.0 

15.0 

75.0 

Percent days before the window 
(model early) 

5.0 

12.0 

4.0 

Probability of being Inside window 

73.0 

73.0 

21.0 
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10. DISCUSSION OF RESULTS AND CONCLUSIONS 


It should be noted that the analysis described Is based on only I year of 
ground-truth data. It Is possible that the scale utilized for the ground-truth 
data may be too coarse (i half a stage) to be used In this type of analysis. 
This Is evident from tables 3 and 4 where the errors are, on the average, one- 
tenth to seven- tenths of a stage off. A small shift In the ground truth could 
conceivably shift the results to yield a different set of conclusions. 

As far as the Feyerherm and Normal planting date models are concerned, the 
Feyerherm model Is closer to the true planting date, as can be seen from the 
results. It Is the more realistic of the two models because It compensates for 
unusual spring planting conditions whereas the Normal model does not. The 1979 
crop year was unusual In that both spring wheat and barley were planted later 
than usual (ref. 7). 

There appeared to be no difference between any of the spring wheat models 
(i.e., RO, Rl, and R2) applied to spring wheat, based on the ground-truth data 
available for evaluation. The differences in the magnitudes of the errors 
between the three models are so small as to be insignificant from a physical 
standpoint, as can be seen from tables 3 and 4. This is true for almost all 
the stage intervals within which the models were evaluated. Since the ground- 
truth data are no more accurate than a one-half stage, any differences in the 
models could probably be attributed to "noise." The same may be said of the 
Robertson and Williams models when they are applied to barley so far as the 
magnitudes of the errors are concerned. It can be seen from figure 7 that the 
Williams model is progressing too fast for barley. 

So far as application to the Reformatted procedure is concerned, the Feyerherm 
model performs adequately for the planting stage while the Improved Robertson 
Version 2 Model performs adequately for the heading stage but not for the 
ripening stage. 
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Modifications to the Original Robertson Model yielded more accurate results at 
the later stages of spring wheat growth than the earlier stages. An example of 
the Improvement In performance can be seen In figure 9 which shows the distri- 
bution of the errors for stages 5.0 to 5.9. Both the Improved versions show a 
smaller amount of variability than the Original Robertson Model. 
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11. RECOMMENDATIONS 


Based on the results to date. It Is recomnended that the Feyerherm planting 
date model be utilized for both spring wheat and barley. It appears that the 
Improved Robertson Version 2 Model Is the more useful for predicting spring 
wheat and barley development stages. However, the model Is not adequate to 
determine window 3 of the Reformatted procedure, which Is used to separate 
barley from spring wheat. Further research on biowindow 3 Is required If 
accurate results are to be obtained for Identifying this window. 
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